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Purpose  and  Agenda 


Purpose :  To  share  information  on  the  TRAC-MTRY  led  representation  of 
uncertainty  within  combat  models  research.  This  research  includes 
representation  of  uncertainty  from  false  positive  targets  and  sensor  errors. 

Agenda: 

•  JDL  Data  Fusion  Model. 

•  False  Positives. 

-  Research  Objectives. 

-  Definition. 

-  Technical  Approach. 

-  Summary. 

•  Sensor  Errors. 

-  Research  Objectives. 
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Joint  Directors  of  Laboratories  (JDL)  Data  Fusion  Model 


Level  1:  Correlation  and  tracking  estimation  of 
unit  position,  velocity,  type,  ID. 

*  Only  level  addressed  further  here. 

Level  2:  Situation  assessment. 

Level  3:  Threat  assessment. 

Level  4:  Process  monitoring  and  optimization. 

Level  5:  Human  computer  interaction. 
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Types  of  Data  in  Level  1  Fusion 
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Types  of  Data  in  Level  1  Fusion 
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False  Positive  Research  Objectives 


*  Collect  necessary  data,  through  research  and 
experimentation,  to  characterize  the  probability  of  false 
acquisitions  in  varying  conditions. 

*  Develop  models  and  methodologies  to  implement  “false 
positive”  acquisitions  within  target  simulations, 
therefore  improving  the  representation  of  information 
ambiguity. 

*  Create  software  to  implement  stand  alone  model  and 
components  for  use  within  JDAFS  and/or  COMBAT  XXI. 
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“False  Positive  Acquisition”  Definition 


•  Permitting  the  possibility  of  false 
positive  target  acquisitions  will  inject 
ambiguity  into  simulated  situational 
awareness  (no  longer  can  you  have 
absolute  confidence  in  own  SA). 

•  This  is  distinct  from  misidentification 
or  misclassification,  where  an  entity 
perceives  incorrect  information  from 
an  existing  entity.  In  a  False  Positive 
acquisition,  there  is  no  other  entity, 
regardless  of  ‘side’. 

•  Redundant  observation  coverage 
becomes  meaningful,  and  actions  may 
be  taken  to  “confirm  or  deny”  SA. 


Possible  Acquisition  Outcomes 
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•  Simulations  solely  relying  upon 
ACQUIRE  implicitly  neglect  all 
acquisitions  on  the  right  side  of  the 
above  chart,  as  ACQUIRE  calculation 
requires  both  an  observer  and  a 
target. 
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False  Positive  Technical  Approach 


*  Develop  and  conduct  appropriate  experiments  to 
capture  additional  data  concerning  False  Positive 
acquisitions. 

*  Develop  models,  based  on  experimentation  results. 

-  Basic  experimental  framework  previously  used  in  a  series 
of  experiments  conducted  in  the  MOVES  Institute  at  the 
Naval  Postgraduate  School. 

-  Experiments  focused  comparing  experimental  human 
performance  at  target  detection  with  probability  of 
detection  as  determined  by  ACQUIRE  and  alternative 
target  acquisition  models. 

-  During  experiment  design,  slides  not  depicting  a  target 
were  inserted  as  controls.  Experiments  registered  false 
positive  target  acquisitions  on  these  slides. 

-  Experiment  design  being  restructured  to  capture 
significant  data  relating  to  false  positives. 

*  Develop  software  to  implement  model. 
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Initial  Factor  Decomposition 
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Example  of  March  08  Experiment 
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False  Positive  Summary 


*  Most  significant  factor  affecting  rate  of  “false  positives” 
is  measurement  of  vertical  edges. 

*  Developed  a  hierarchical  decomposition  of  false  positive 
perceptions  and  an  associated  list  of  contributing 
factors. 

*  Leveraging  previous  work  at  Naval  Postgraduate  School 
to  shape  the  human  performance  experimentation. 

*  Developing  a  model  that  will  produce  a  distribution  and 
characterization  of  false  positive  perceptions  based  on 
the  provided  inputs. 

*  Experimentation  will  also  capture  data  that  can  analyze 
subject  search  patterns  for  simulation  representation. 

*  Developed  a  versatile  research  tools  and  capabilities 
that  can  be  utilized  to  support  future  perception  and 
information  research. 
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Types  of  Data  in  Level  1  Fusion 
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Ambiguity  of  Sensor  Detection  Research  Objectives 


*  We  seek  to  introduce  ambiguities  in  data  association 
into  modeling  and  simulation  (tactical-level).  We  seek  to 
increase  the  fidelity  of  situational  awareness 
representation  by  more  accurately  representing 
uncertainty  in  modeling  association,  fusion,  and  BDA. 

*  Goals  for  this  project: 

-  Create  a  flexible  descriptive  model  that  realistically 
accounts  for  inaccurate  /  uncertain  identification  / 
classification  /  affiliation  of  acquired  entities  and 
accounts  for  imperfect  association  of  this  information 
(association  model). 

-  Create  new  BDA  representations  that  better  account  for 
uncertain  inputs  such  as  false  positives  and  sensor  error. 

-  Provide  probability  confusion  matrix,  for  vehicles,  for  not 
only  misidentification  but  misrecognize  and  misclassify. 

-  Provide  elliptical  error  probablilities  for  sensor  target 
location  errors,  capturing  the  asymmetry  of  sensor  TLEs 
in  range  and  azimuth. 
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Technical  Approach 


The  hard  part  of  multiple  target  tracking  is  associating 
measurements  with  targets.  Current  model  knowledge  structures  do 
not  adequately  account  for  associating  ambiguity: 

-  Association  algorithms  are  needed  to  account  for  directional  and 
range  uncertainty  of  sensors  in  addition  to  time  delays  and  decays 
associated  with  sensed  position  information.  Currently  looking  to 
expand  Maneuvering  Target  Statistical  Tracker  (MTST). 

-  Identification  errors  and  false  detects  are  not  accounted  for  in  current 
fusion  /  decision  algorithms. 

-  Fusion  algorithms  such  as  the  Kalman  filter  adequately  provide  fusion 
for  information  association  models,  however,  these  filters  assume 
well-defined  association  algorithms. 

-  Most  current  computer  generated  force  (CGF)  based  simulation 
models,  which  tend  to  include  behavior  models  that  perform 
automated  decision  making,  rely  on  the  AMSAA  heuristic  for  BDA 
modeling  and  do  not  adequately  represent  current  BDA  doctrine  /  TTP 
and  associated  commander  decisions. 

Prototype,  proof-of-concept  implementation  will  use  the  Joint 
Dynamic  Allocation  of  Fires  and  Sensors  (JDAFS/DAFS)  simulation 
that  forms  the  basis  for  an  API  into  CombatXXI. 
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BDA  in  the  Combat  Assessment  Process 


Assess 


Combat 

Assessment 

Critical  assessments  of  strike 
effects. 

Determines  battle  damage, 
reattack  recommendations, 
and  munitions  performance. 


Mission  Planning 
and  Force  Execution 

Detailed  operational  planning 
and  execution  of  operations. 


Deliver 


Decide 


Commander’s  Objectives, 
Guidance,  and  Intent 

Identifies  military  targets/objectives 
in  support  of  national  objectives, 
and  key  limitations  on  operations. 
Drives  subsequent  phases 
of  the  targeting  cycle. 


Commanders  Decision 
and  Force  Assignment 

Validates  that  the  target  supports 
commander's  objectives. 
Provides  formal  command 
approval  for  the  strike. 


Target 

Development 

Relies  on  the  interaction  of 
intelligence  assets  to  identify 
target  characteristics  and 
validate  that  the  target  is  legal. 


Capabilities 

Analysis 

Assesses  the  availability  of 
strike  assets  and  forces. 
Ensures  achievement  of  desired 
outcomes  and  objectives. 


Detect 


Source;  DQD. 

•  Perceived  BDA  is  one  of  the  most  complex  and  uncertain  processes 
facing  the  soldier  in  live  combat. 

•  Modeling  and  simulation  community  has  yet  to  adequately  model  the 
perceived  BDA  process  in  combat  models. 
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Common  Battle  Damage  Assessment  (BDA)  Description 


Three  possibilities  of  BDA  entity  description: 

1.  No  Information. 

2.  No  damage. 

3.  Damage  specified  by  kill  type. 

-  (F)  Firepower. 

-  (M)  Mobility. 

-  (MF)  Mobility  and  firepower. 

-  (K)  Catastrophic. 

By  Entity  Type: 

-  Vehicles  (F,  M,  MF,  or  K). 

-  Infantry  (only  K). 
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Improving  BDA  Methodology 


•  Generate  and  execute  WEB  Survey  with  NPS  OR  students 
with  prior  experience  in  BDA. 

•  Empirically  determine  probabilities  for  the  conditional 
distributions  of  events  for  each  given  kill  state. 

•  Implement  results  in  JDAFS. 

•  Handoff  results  to  TRAC-WSMR  for  Combat-XXI. 
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Summary 


*  Result  is  a  flexible  descriptive  model  that  realistically 
accounts  for  inaccurate  /  uncertain  identification  / 
classification  /  affiliation  of  acquired  entities  and 
accounts  for  imperfect  association  of  this  information 
(association  model). 

*  Result  is  an  expanded  model  that  better  accounts  for 
uncertainty. 

*  Implementation  will  be  a  prototype,  proof-of-concept 
implementation  using  the  Joint  Dynamic  Allocation  of 
Fires  and  Sensors  (JDAFS/DAFS)  simulation  that  forms 
the  basis  for  an  API  that  may  be  used  by  COMBAT  XXI . 
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Questions 


Point  of  contact  is 


Dr.  Tom  Anderson 
TRAC-Monterey  ERDC  liason 
thomas.anderson5@us.army.mil 
Phone  831-656-2977 
DSN  756-2977 
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